Emergent exploration via novelty management.
نویسندگان
چکیده
When encountering novel environments, animals perform complex yet structured exploratory behaviors. Despite their typical structuring, the principles underlying exploratory patterns are still not sufficiently understood. Here we analyzed exploratory behavioral data from two modalities: whisking and locomotion in rats and mice. We found that these rodents maximized novelty signal-to-noise ratio during each exploration episode, where novelty is defined as the accumulated information gain. We further found that these rodents maximized novelty during outbound exploration, used novelty-triggered withdrawal-like retreat behavior, and explored the environment in a novelty-descending sequence. We applied a hierarchical curiosity model, which incorporates these principles, to both modalities. We show that the model captures the major components of exploratory behavior in multiple timescales: single excursions, exploratory episodes, and developmental timeline. The model predicted that novelty is managed across exploratory modalities. Using a novel experimental setup in which mice encountered a novel object for the first time in their life, we tested and validated this prediction. Further predictions, related to the development of brain circuitry, are described. This study demonstrates that rodents select exploratory actions according to a novelty management framework and suggests a plausible mechanism by which mammalian exploration primitives can be learned during development and integrated in adult exploration of complex environments.
منابع مشابه
Designing for Interest and Novelty Motivating Design Agents
This paper is concerned with the motivation of design agents to promote the exploration of design spaces. A general form of motivation common to designers is a curiosity to discover interesting designs. This paper presents computational models of interest and curiosity based on the detection of novelty. We illustrate the behaviour of our model of interest in emergent properties of a design and ...
متن کاملComputational novelty: Phenomena, mechanisms, worlds
We want to implement a variety of computer programs capable of generating unbounded novelty via emergent evolution. We also want a principled, structured way of analysing our novelty-generation programs and improving them over time. We have developed a definition of embodiment in terms of a conceptual framework of hierarchical phenomena, mechanisms, and worlds, for use in analysing and building...
متن کاملAutonomous visual exploration creates developmental change in familiarity and novelty seeking behaviors
What motivates children to radically transform themselves during early development? We addressed this question in the domain of infant visual exploration. Over the first year, infants' exploration shifts from familiarity to novelty seeking. This shift is delayed in preterm relative to term infants and is stable within individuals over the course of the first year. Laboratory tasks have shed lig...
متن کاملNovel Properties Generated by Interacting Computational Systems
In this work we address two questions: first, what is the smallest number of components a computational system needs in order to display genuine novelty? And second, can the novel features of such systems also exhibit novel causal powers? The possibility of generating novelty via computational processes has been an ongoing topic of investigation and debate in artificial intelligence research fo...
متن کاملJuridical exploration in women’s urban management contribution
The issue under women’s involvement or lack of involvement in political and social activities refers to one of the most controversial issues to which a large body of scientific efforts and discussions has allocated. One of these activities includes tenure of religious authority by women which is of great importance due to abundant outcomes. The present research intends to examine juridical expl...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- The Journal of neuroscience : the official journal of the Society for Neuroscience
دوره 34 38 شماره
صفحات -
تاریخ انتشار 2014